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(57) Abstract 

Voice recording is initiated immedi- 
ately upon pressing a record button (20) on 
a hand held digital computting device such 
as a palm computer. To enable an imme- 
diate response to the button being pressed 
without a delay that would normally be in- 
curred to load a user interface and a record- 
ing application, a stub program is continu- 
ously executed on the device, even when a 
main user interface program is not running. 
When the record button is pressed, the stub 
program immediately begins recording a dig- 
ital signal corresponding to the sound waves 
incident on a microphone (30) of the device. 
The digital signal is compressed and if the 
record button is depressed for more than a 
second, the recorded digital signal is stored 
in a file so that it can subsequently be played 
back, and if the record button was pressed 
for less than one second, the file is not re- 
tained. 
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FAST START VOICE RECORDING ON A HAND HELD DIGITAL 

DEVICE 
Field of the Invention 

The present invention generally relates to a portable digital computing 
5 device for use in storing and accessing data, and more specifically, to a digital 
computing device that is sufficiently small to be hand held and which normally 
uses a microprocessor driven user interface display screen to control applications 
executed on the digital computing device, including a sound recording 
application. 

1 o Background of the Invention 

Portable computing devices ranging in size from credit card sized personal 
data assistants to laptop computers have become increasingly popular for use by 
business people and others who must travel about and thus cannot readily access 
information stored on their desktop computer or office network workstation. 

1 5 Although laptop computers are capable of running virtually all of the application 
programs that execute on desktop machines, they often weigh more than seven 
pounds and cannot be readily carried about in a pocket or purse. There is thus an 
increased demand for substantially smaller palm type computers that are able to 
run business applications of less complexity than those designed to run on a 

20 desktop computer and which enable a user to quickly access all types of personal 
and business related data, such as addresses, telephone numbers, scheduled 
appointment times, etc. 

Although laptop computers usually include a keyboard sufficiently large to 
enable relatively efficient text entry, smaller palm type computers usually do not. 

25 If a keyboard is provided on such machines, it is typically too small to permit 
touch typing. Text entry may be available only through a touch screen that 
displays a reduced-size representation of a keyboard, permitting characters to be 
entered with a stylus, a carefully positioned finger, or another small diameter 
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pointing object. Clearly, it would be preferable to provide an alternative 
technique to enter information that does not require the user to use a keyboard. 

Even if a keyboard is provided on a computing device that is sufficiently 
large to enable a user to enter text efficiently by hand, the touch typing text entry 
5 process requires both hands and requires both eye/finger coordination, and 
substantial attention to the process. Thus, it is not possible to safely drive a 
vehicle while typing an entry on a computer keyboard. However, there are many 
occasions when a person simply wants to enter a quick memo or reminder of some 
event, or make note of information. These occasions may occur, for example, 

10 while talking to someone on a phone. At such times, entry of the text on a small 
touch screen display keyboard or even on the relatively larger keyboard of a 
notebook computer may not be practical. Instead, it would be preferable to enable 
the user to make a recording of the verbal information, thereby eliminating the 
need to enter it as text, via a keyboard. Although portable, hand held analog or 

15 digital recorders are currently available, it would be preferable to provide the 
voice recording capability on a portable computing device that also stores other 
types of data and is capable of running useful application programs, so the user 
need not carry about both a dedicated recorder and a digital computing device. 

If a digital voice recording capability is provided in a hand held digital 

20 computing device, one potential problem or annoyance may be the time delay 
required to start recording a note. Hand held digital computing devices typically 
have a limited amount of memory and often use slower and less powerful 
processors than desktop computers. Accordingly, it is likely that the delay 
required to launch a user interface (UI) from which a voice recording application 

25 can be started would be unacceptable to most people. The time required to boot 
up a hand held computing device and select a voice recording option could easily 
be 5 seconds or more. An individual who wants to record a thought or make note 
of information that is being provided by another person would not want to wait 
that long before starting to record the data. Instead, it is important to enable the 

30 voice recording to start immediately, for example, so that the user need only push 
a button and begin speaking, even if the digital computing device has not 
previously been used and the UI is not available to execute a voice recording 
application. 

Also, the user should be able to initiate the voice recording operation in an 
35 "eyes free" mode, by pushing a predefined control button on the device, which 
can be identified and actuated solely by feel and location on the computing 
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device. The sound recording function will then be immediately usable at any 
time, will be operable with one hand (or finger), and will be usable under low 
light conditions and while engaging in other activities such as talking on the 
telephone or driving a vehicle. This feature would also be employed with other 
5 applications or functions that must be started immediately without requiring the 
user to first launch a UI on a display screen of the hand held computing device, 
and without requiring the user to see the device in order to run the application. 

Summary of the Invention 
In accord with the present invention, a hand held digital computing device 

10 that immediately implements a predefined function in response to a user action, 
independent of whether a main user interface is currently running on the digital 
computing device, is defined. Included is a power supply for providing electrical 
power to energize the device. A memory is provided for storing machine 
instructions, and a switch is disposed on the housing, so that it is readily actuated 

15 by the user. A processor is coupled to the memory and to the switch and executes 
the machine instructions to carry out a plurality of functions. A portion of the 
machine instructions comprises a stub program that typically runs continually (or 
at least until the power supply is de-energized), and another portion of the 
machine instructions comprises a main program that is substantially larger than 

20 the stub program. The main program is selectively executed by the processor to 
provide the main user interface, while the stub program is adapted to immediately 
respond to a user actuating the switch by implementing the predefined function, 
even when the main program is not currently running and the main user interface 
is thus not currently available. 

25 If the main program is not yet running, the stub program is adapted to 

cause the processor to launch the main program in response to the user actuating 
the switch. In the preferred application of the present invention, a microphone 
that produces an analog signal corresponding to sound waves that are incident on 
the microphone is also included. An analog-to-digital (A/D) converter is coupled 

30 to the microphone and to the memory and is employed for converting the analog 
signal produced by the microphone into a digital signal that is stored in the 
memory. The predefined function then comprises storing the digital signal from 
the A/D converter in the memory to record the sound waves that are incident on 
the microphone. 

35 The stub program is adapted to cause the processor to at least temporarily 

store the digital signal in the memory until the user stops actuating the switch. 
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However, the stub program causes the processor not to save the digital signal if 
the user actuates the switch for less than a predefined interval. In this case, the 
stub program causes the processor to launch the main program and discards the 
digital signal that was held in the memory. In addition, the stub program 
5 preferably further compresses the digital signal and saves the digital signal in the 
memory in a compressed format, so that less memory is required for storing such 
data than would be required to stored the digital signal uncompressed. 

Preferably, the hand held digital computing device also includes a sound 
transducer that produces audible sounds in response to an applied analog signal, 

10 and a digital-to-analog (D/A) converter that is coupled to the memory to receive 
the digital signal stored therein and produce the applied analog signal that is input 
to the sound transducer. The applied analog signal input to the sound transducer 
causes it to produce audible sounds corresponding to the digital signal to play 
back the sounds that were stored. 

15 The main program (or an application program that runs under the main 

program) includes functions for controlling the playback of the digital signal 
stored in the memory. These functions are controlled using a plurality of controls 
adapted to be actuated by the user. Included is a control for initiating the 
playback of the digital signal stored in the memory to produce the sound waves 

20 that were incident on the microphone. Also, one of the plurality of controls is 
adapted to cause the playback of the digital signal at a speed substantially greater 
than a rate at which the digital signal was provided to the memory by the A/D 
converter. Still another of the plurality of controls is adapted to move back 
through the digital signal stored in the memory when continuously actuated by the 

25 user, in a manner analogous to selectively rewinding through the stored digital 
signal. The duration of the portion thus "rewound" is preferably greater than the 
time that the control is actuated during the rewind operation. 

Further, the machine instructions cause the processor to store the digital 
signal as a file, in a folder specified by the user. The user can preferably identify 

30 the folder by speaking its name into the microphone. 

A data port adapted for transmitting the file to another computing device 
may also be included, so that the digital signal stored in a file can be transferred to 
the other computing device, e.g., to a personal computer. Further, the main 
program is preferably adapted to enable the user to record words spoken with the 

35 microphone, for inclusion in an e-mail message. 
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Another aspect of the present invention is directed to a method for 
immediately implementing a predefined function in response to a user action on a 
hand held digital computing device, independent of whether a main user interface 
is currently running on the hand held digital computing device. The steps of the 
5 method are generally consistent with the functions discussed above. 

Brief Description of the Drawing Figures 
The foregoing aspects and many of the attendant advantages of this 
invention will become more readily appreciated as the same becomes better 
understood by reference to the following detailed description, when taken in 
10 conjunction with the accompanying drawings, wherein: 

FIGURE 1A is a block diagram showing functional components of a 
portable hand held computer that implements the present invention; 

FIGURE IB is a schematic top view of the portable, hand held computer 
of FIGURE 1A; 

15 FIGURE 2 illustrates a main command button bar provided by the user 

interface that is displayed on a touch screen of the portable hand held computer 

shown in FIGURES 1 A and IB- 
FIGURE 3 illustrates a list view button bar provided in the user interface 

of the hand held computer; 
20 FIGURE 4 illustrates a display window provided on the hand held 

computer in which are listed exemplary recorded files that are stored on a personal 

computer memory card international association (PCMCIA) (or simply "PC") 

card, which is connected to the hand held computer; 

FIGURE 5 is an option dialog box for selecting the fields that will be 
25 employed for displaying information regarding the sound files recorded on the 

hand held computer; 

FIGURE 6 is a dialog box listing options for controlling the operation of 

the hand held computer and the saving of sound files on the PCMCIA card (or in 

memory); 

30 FIGURE 7 is a volume slider control for setting the speaker volume on the 

hand held computer; 

FIGURE 8 is a flow chart illustrating the logical steps implemented during 
the recording of sound on the hand held computer; and 

FIGURE 9 is a flow chart illustrating the logical steps for playing back a 
35 previously recorded sound file or note on the hand held computer. 
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Description of the Preferred Embodiment 

Hand Held Computing Device 

While the present invention is not limited in its application to a palm type 
computer or to a hand held personal computer, it is initially expected to be used 
5 on these types of devices. Furthermore, the preferred embodiment of the present 
invention is directed toward the fast start of a voice recording on a hand held 
digital computer, enabling the computer to be used to recording memos, notes, 
and other sound data. A schematic block diagram of the components comprising 
a hand held digital computer 10 that implements the present invention is shown in 

10 FIGURE 1A; FIGURE IB shows further physical details of an exemplary 
embodiment for such a device. 

Referring now to FIGURES 1A and IB as appropriate, it will be noted that 
hand held digital computer 10 includes a central processing unit (CPU) 12, which 
implements machine language instructions to carry out various functions 

15 performed by the device. These machine language instructions are stored in a 
memory 28, which is bi-directionally coupled to CPU 12 through a databus 14. 
Alternatively, the databus may be omitted if the components shown coupled 
through the databus are instead directly coupled together. The machine 
instructions that execute on CPU 12 are divided into a relatively small subset 

20 referred to as a stub program (e.g., a program of about 10 Kbytes) and a 
substantially larger subset (typically substantially more than 100 Kbytes) that is 
employed for implementing a user interface and for running selected applications 
on hand held digital computer 10. The user interface is presented on a touch 
screen display 18, which is coupled to databus 14 through a display driver 16, 

25 which produces the signals required to create the user interface display screens 
and touch controls. When the user touches touch screen display 18, it responds by 
producing a signal corresponding to the relative x, y position on the screen that is 
preferably input to CPU 12 through databus 14. Accordingly, a main menu that is 
part of the user interface that appears on touch screen display 18 enables the user 

30 to select various options, including launching and controlling applications 
executed by CPU 12. Although not shown, the main user interface preferably 
includes the display of a touch screen keyboard that replicates the keys found on a 
conventional keyboard for a personal computer, but is preferably activated with a 
stylus or a finger of one hand (due to its relatively small size). 

35 Five hardware control buttons or switches are provided for controlling 

hand held digital computer 1 0. The control buttons are disposed to the left of 
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touch screen display 18 and are mounted on the upper surface of a housing 44 so 
that they are readily accessible and can be actuated by the fingers of the hand 
holding the housing. It will be appreciated that the control buttons can be 
disposed in entirely different locations, as desired or to work more efficiently with 
5 a different shape or configuration of the housing. 

The first of these control buttons is an action button 1 9 having a function 
that generally corresponds to that provided by the enter key oil a conventional 
keyboard or that provided by selecting "OK" in a dialog box. Below the action 
button is a record button 20, which is used to initiate immediate recording of 
10 sound, as explained below. An exit button 22 performs a function analogous to 
the escape key provided on a conventional personal computer keyboard. A rocker 
up button 24 and a rocker down button 26 are also provided, and these buttons 
perform functions that are generally analogous, respectively, to the up and down 
keys used on a conventional personal computer keyboard to move a caret or 
1 5 selection point respectively up and down in the display. 
Sound Recording and Play 

To enable sound recording on hand held digital computer 10, a 
microphone 30 is provided within the housing, appearing at the upper right comer 
of the device as illustrated in FIGURE IB. The output signal from microphone 30 
20 is an analog signal characterized by frequencies and amplitudes corresponding to 
the frequencies and amplitudes of the sound pressure waves that are incident on 
the microphone. An A/D converter 32 converts the analog signal produced by 
microphone 30 into a corresponding digital signal that is applied to databus 14 for 
processing by CPU 12. 
25 The digital signal that is output from A/D converter 32 is preferably 

compressed by the CPU before being stored in memory 28. The compression 
algorithm that is used in a preferred embodiment is provided by Hewlett-Packard 
Corporation and is referred to as the MOBILE VOICE compression routine; 
. however, it should be apparent that other compression schemes (or none) can 
30 alternatively be used. The MOBILEVOICE routine is a parametric coder, i.e., a 
model of speech production is used to analyze the uncompressed digital signal, 
and only the resulting model parameters (comprising a compressed digital signal) 
are stored. This routine yields a very low bit rate and requires only moderate 
computation, but requires a good fit between the speech model and the input 
35 speech. The required fit to the model is best achieved when the user speaks 
clearly, close to the microphone. The model is an enhanced version of the well- 
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known linear predictive coding (LPC) system, employing ten coefficients as 
parameters that describe the speaker's vocal-tract shape and voice pitch, and a flag 
to indicate if the speech is voiced or unvoiced. Using the MOBILE VOICE 
compression routine, the compressed digital signal is stored in memory 28 at the 
5 rate of about 300 bytes per second, which corresponds to a rate of approximately 
8000 bytes per second for the uncompressed digital signal output from A/D 
converter 32. Approximately one kilobyte of recorded sound in the compressed 
format is saved in memory 28 each 3.3 seconds of recording time. The 
compressed digital signal that is stored in memory 28 can alternatively be directly 

10 stored in a PCMCIA storage card 40, which is connected to hand held digital 
computer 10 by insertion into a PC card slot 49 (shown in FIGURE IB). 

To play back a recorded sound file, the compressed digital signal is 
uncompressed by CPU 12 using an inverse of the compression procedure 
employed to create the compressed digital signal, and the resulting uncompressed 

15 signal is applied to the input of a D/A converter 34, which converts the digital 
signal after it is uncompressed into a corresponding analog signal. This analog 
signal is applied to the input of an amplifier/driver module 36, which produces a 
driving signal for a speaker 38. Speaker 38 is shown in FIGURE IB disposed at 
the upper left corner of housing 44, but it can be located at other positions on the 

20 housing. It should also be noted that headphones or an earphone may also be 
employed for listening to the sound if connected to the device through an 
appropriate mini phone jack (not shown) that is mounted on housing 44. 

A power supply 42 provides the required voltages for each of the active 
elements on hand held digital computing device 1 0. Although only a single 

25 voltage line is illustrated in FIGURE 1A, it will be understood that different 
voltages required by the active components of the device are supplied by power 
supply 42, which preferably includes a battery (not separately shown). The 
battery can be coupled to an AC line (not shown) for recharging. 

Hand held digital computer 1 0 preferably includes an infrared port 46 (also 

30 referred to as an infrared data access (IRDA) port) that enables bidirectional 
transfer of files between the device and a personal computer or another hand held 
computer that is provided with a corresponding infrared port. Since such ports are 
well known in the prior art, details of the port need not be included in the present 
disclosure. 

35 A primary feature of the present invention is its ability to immediately 

initiate sound recording when the user depresses record button 20 regardless of 
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whether the user interface is currently being executed by CPU 12. To respond to 
the depression of record button 20 for starting immediate voice recording, the stub 
program stored in memory 28 remains active at all times, even when the main 
program is not being executed by CPU 12. When the main program is not 

5 running, touch screen display 1 8 appears blank, and hand held digital computer 1 0 
appears to be inactive. However, so long as power supply 42 is energizing the 
required components in the hand held computer, and assuming that the stub 
program has been initiated after power was applied to the components, the device 
remains ready to immediately start recording voice or other sounds that are 

1G incident on microphone 30 in response to the user depressing record button 20. 
The user is not required to wait until the main user interface is launched and/or 
until a sound recording application is executed, but instead can immediately begin 
recording with the hand held computer. 

If the main program is already being executed by CPU 12 so that the user 

15 interface is running, touch screen display 18 displays a record/play toolbar 50, 
generally as shown in FIGURE 2. Record/play toolbar 50 includes a record 
control 52, which when touched by the user, provides an alternative way to initiate 
the recording of sound waves incident on microphone 30. It should be noted that 
record/play toolbar 50 is a graphic image that defines control zones on the touch 

20 screen display to which the CPU responds if any such control zone is actuated 
with a stylus or finger. A stop control 54 is also provided on record/play 
toolbar 50, for use in stopping the recording of sound. By actuating record 
control 52, the user can selectively record a sound file. The record control is 
preferably employed (instead of the record button 20) to record sound for an 

25 extended period of time, e.g., conversations occurring during an extended 
meeting. The recording time is limited only by the amount of memory available 
on the device. By using record/play toolbar 50 to initiate the recording of a 
meeting, the user is not required to hold record button 20 depressed during the 
entire time interval that sound is being recorded. 
30 The user interface can also be employed for recording a sound file for 

inclusion in an E-mail message. The E-mail message can be initiated, and the 
sound file recorded by employing the user interface controls or the record button. 
The sound file then becomes a part of (or an attachment to) the E-mail message. 
Alternatively, a previously recorded sound file can be attached to an E-mail 
35 message. 
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A rewind control 66 can be selected to back up through a sound recording 
by approximately two seconds each time the control is actuated. Play continues 
from the new position in the file if the control is actuated while a file or note is 
playing. . 

5 It is also possible to use rocker up button 24 for rewinding through a file 

that is being played. The rocker up button can be actuated to rewind back through 
the sound recording by approximately 500 milliseconds at a time, repeating while 
the button remains depressed. Each 500 milliseconds of rewind time corresponds 
to about two seconds of actual recorded sound. For every 500 milliseconds of 

10 rewind time, a "beep" sound is produced through speaker 38 (see FIGURE IB). 

A forward control 68 performs a function analogous to that of rewind 
control 66, skipping forward in a sound file by approximately two seconds each 
time that the control is actuated (i.e., tapped) while a file or note is NOT playing. 
If control 68 is actuated while a file is playing, the control remains depressed and 

1 5 causes the file to play at a fast play speed until the control is tapped again. The 
fast play speed is equal to approximately 1.5 to 2 times the normal play speed. 
However, the frequency of the sound produced during the fast play speed is not 
substantially different than the normal play speed, i.e., it does not sound unusual, 
other than playing faster. As soon as forward control 68 is tapped again during 

20 fast play speed, normal play speed is resumed and control 68 appears to pop back 
up when released. 

Alternatively, fast play speed can be selected using rocker down button 26. 
If rocker down button 26 is held depressed during the playing of a file, the same 
fast play speed is achieved while the control button remains depressed. Play at 

25 normal speed resumes when the rocker down control button is released. Forward 
control 68 appears to be depressed on touch screen display 1 8 while rocker down 
button 26 is depressed. 

A slider 64 is provided to indicate the relative position in a sound file; the 
slider operates differently depending upon whether the user is recording a note or 

30 file or is playing back a previously recorded note or file. During recording, the 
full slider travel length indicates a total time of 15 seconds and the current timing 
as the slider moves from left to right while the file is being recorded. If the user 
continues to record beyond the 1 5 seconds time, the slider restarts at the beginning 
(to the left) after it reaches the end of its travel (at the right); it repeats this action 

35 for successive 15 second intervals. During playback of a sound file, the total 
length of the track along which the slider travels represents the duration of the file 
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that is being played, and the position of slider 64 between the left and right 
extreme ends of the track indicates the relative current point in the sound file. 

Record/play toolbar 50 also includes a play/pause control 56, which is 
used for playing recorded sound files and pausing during the playback, A volume 
5 control 58 can be selected to display a volume control 130, as shown in 
FIGURE 7. 

Referring to FIGURE 7, volume control 130 includes a slider 132 that the 
user can touch and move upwardly or downwardly to select a relative volume for 
the audible sound during playback. A plurality of bars 138 indicate the relative 

10 playback volume, i.e., shorter bars adjacent to the position of slider 132 indicate 
that the volume is decreased, while if the slider is moved adjacent to relatively 
longer bars, a louder playback volume is provided. An OK control option 134 is 
selected to dismiss the volume control dialog. 
Storing Sound Files in Folders 

15 Referring back to FIGURE 2, a control 60 can be tapped on the touch 

screen display to list the properties of a selected file listed in a box 70. To delete a 
file or folder, a delete control 62 is included on record/play toolbar 50. Box 70 
lists a current folder, but additional folders can be displayed (if they exist) by 
selecting a drop-down list control 72. When this control is selected, a toolbar 80 

20 is illustrated, as shown in FIGURE 3. In this Figure, a drop-down list window 70' 
displays a selected folder name INVENTORY, which is also included as the 
bottom entry of a drop-down list 86. Additional entries include "ALL NOTES" 
corresponding to a listing of all of the recorded sound files, "FOLDERS..." 
corresponding to a list of all of the folders, and the folder named "HOME." 

25 Recorded sound files can be transferred to another computer such as a desktop 
personal computer by transmission through either a conventional serial port or via 
the infrared port provided on the hand held computer. 

If the user selects ALL NOTES option in the list box, then all of the notes 
that are resident in the folder "MY DOCUMENTS," including those one 

30 subdirectory deep, are displayed. It should be noted that in the current preferred 
embodiment, only the concept of "projects" exists, not the concept of directories. 
If a file has not been assigned to a selected project, then it is assigned to a default 
project "ALL." Toolbar 80 also includes volume control 58, control 60, and 
delete control 62. A cancel control 84 can be selected if the user does not want to 

35 proceed with selecting a file or folder from the drop down listing. 
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In FIGURE 4, an exemplary sound file listing includes three notes that 
have been recorded and are stored. Specifically, a dialog window 90 lists notes 
named "Hot Tip," "Mongoose," and "Lightning" under a column heading 92. In 
addition, a column heading 94 indicates the date and time at which each of these 
5 notes was recorded, while a column heading 96 indicates the duration in seconds 
of each note. At the bottom of this Figure, a status box 98 indicates whether a file 
is currently being recorded or a sound file is being played and gives an indication 
of the signal strength, i.e., either a recording level or a playback level. A 
block 1 00 indicates the length and current time position in the file. In the example 

10 shown in FIGURE 4, a file being played back has played through five seconds of 
its total 20 second duration. When recording, block 100 indicates the time lapsed 
since the current recording was started, for example, "8 S" indicates that eight 
seconds of recording have been completed. A block 102 states how many seconds 
remain available for recording sound files as a function of the available memory 

15 on the hand held digital computer. In the example shown, 189 seconds remain 
free for recording one or more sound files. 
Setting Options 

Referring now to FIGURE 5, a dialog box 110 illustrates the options 
available in the user interface that relate to the record and playback functions. In 

20 this particular dialog box, the user can select the columns that will be displayed 
when the list of recorded notes or files is provided (as shown in the example 
discussed above in connection with FIGURE 4). A list box 1 12 includes each of 
the columns that can be displayed and includes check boxes 1 15 in which the user 
can selectively indicate the columns that will be included when the files are 

25 displayed. The relative position of a selected column entry in the display can be 
changed by using a "move up" control 1 14, or a "move down" control 116. 

FIGURE 6 illustrates a dialog box 1 1 8 that is provided to enable the user to 
set general options in regard to controlling the recording of sound files. In this 
dialog box, a check box 122 can be checked to enable a "beep feedback" when 

30 playing and recording sound files. If not checked, the audible beep is no longer 
used during record and playback functions. A check box 124 can be checked to 
indicate that the user wishes to save recorded files to a PCMCIA storage card. A 
drop-down list box 120 enables the user to identify the name of the particular 
storage card that such notes are to be saved to. If the indicated storage card is not 

35 inserted into the hand held digital computer, the files are instead saved to the 
memory (e.g., memory 28 in FIGURE 1 A). 
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There are two possible options that the user can choose by selecting a radio 
button 126 or a radio button 128. These options determine the action of the hand 
held digital computing device when record button 20 (referred to here as the "voice 
recorder button") is pressed and held. If radio button 126 is checked, pressing and 

5 holding the voice recorder button starts the recording and launches the voice 
recording application so that record/play toolbar 50 (shown in FIGURE 2) appears 
on the user interface. However, if radio button 128 is selected, pressing and holding 
the voice recorder button immediately starts the recording, but the voice recording 
application or toolbar is not brought to the foreground on touch screen display 18. 

10 Flow Charts for Recording and Plaving Sound Files 

Further details related to the logic employed for using record button 20 to 
immediately start the recording of a memo or note are shown in FIGURE 8. In a 
decision block 150, a determination is made as to whether any control button, e.g., 
record button 20, has been assigned to the stub program in the registry of the 

15 operating system. In the preferred embodiment, the hand held digital computing 
device employs Microsoft Corporation's WINDOWS CE operating system, which 
uses a registry for defining the functionality of hardware and software components 
employed on the device. It is contemplated that in some instances, the user may be 
provided the option of assigning a different control button to the stub program in the 

20 registry (or selecting a different application that will be immediately started when 
the selected control button is actuated). If the results in decision block 150 is 
negative, a block 152 indicates that sound recording can only be activated with the 
user interface. For example, the user can elect a menu option that brings up 
record/play toolbar 50, as discussed above. However, if .a control button has been 

25 assigned to the stub program in the registry, a block 154 provides for getting the 
control button that is assigned. Next, a block 156 provides for registering the 
control button using an application programming interface (API) referred to as the 
"HOT KEY() API." (See the description of this API below.) 

Following either block 152 or block 156, a decision block 158 determines if 

30 the record control button that has been assigned to the stub program was pressed. If 
it was, a block 160 immediately starts the recording process, activating the input of 
digital information from the A/D converter coupled to microphone 30. This digital 
signal is compressed in real time and retained in memory as the recording process 
continues. A block 162 launches the user interface, assuming that it has not already 

3 5 been launched. Further, as indicated in a block 164, the stub program tells the user 
interface that a sound recording has been started. 
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A decision block 166 then determines if the record control button has been 
released. If not, the logic loops back until the control button is released. Once the 
record control button, e.g., record button 20 has been released, a decision block 168 
determines if the control button had been pressed for less than one second. If the 
5 record control button was pressed for less than a second, the recorded file being 
stored in the memory is discarded, as provided in a block 170. However, if the 
record control button has been pressed for one second or more, a block 172 stores 
the recorded file, either in memory 28, or on the PCMCIA card designated by the 
user, as noted above, assuming that the PC card is present in the hand held digital 

10 computing device. Following either blocks 170 or 172, a block 174 tells the user 
interface that the recording is completed for the file, since the sound file has either 
been discarded or stored. Thereafter, the logic returns to decision block 158 to wait 
until the record control button is pressed. Alternatively, as indicated by the OR 
linking decision block 158 with a decision block 176, a determination is made 

15 (while waiting for the record control button to be pressed) of whether the user 
interface recording mode had been selected by the user touching the record control 
on record/play toolbar 50. If so, a block 178 provides for starting the recording. 
Recording continues, as indicated by a decision block 180, until stopped by using 
the stop button (or by filling all available memory). If the user interface initiated 

20 recording is stopped, the logic again proceeds to store the recorded file in 
block 172. Based on this logic, it will be apparent that either of the two optional 
techniques can be used for starting a recording. More importantly however, a user 
can immediately start recording by depressing the record control button, assuming 
that it has been assigned to the stub program in the registry. Alternatively, the user 

25 has the option of employing the user interface voice record/play toolbar to initiate 
the recording. By simply quickly depressing the voice record control button and 
releasing it, the user can selectively launch the user interface, enabling the 
record/play toolbar to be displayed and thereby using that option for initiating and 
controlling the recording and playback of sound files. 

30 FIGURE 9 illustrates the logic employed for controlling the play of a sound 

file previously recorded. The logic begins at a decision block 190, which 
determines if the voice recorder is playing. If it is, a decision block 192 determines 
if the record button was pressed. If so, a decision block 194 determines if the 
button was pressed again within 750 milliseconds, which constitutes a double tap on 

35 the record button. If so, a block 198 provides that the current file being played 
stops playing, and then the logic proceeds to begin playing all of the sound files in 
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sequence, beginning with the first file in the list. The logic then returns to decision 
block 190. However, a negative response to decision block 194 indicates that the 
record button was pressed again after 750 milliseconds had elapsed between its 
previous press, so that the second press initiates a pause of the current sound file 
5 that is being played back, as generally indicated in a block 196. After block 196, 
the logic again returns to decision block 1 90. 

A negative response to decision block 190, which occurs when the voice 
recorder is not currently playing, leads to a decision block 200, which determines if 
the record button was pressed. If so, a block 202 plays the sound file currently 

10 selected. The logic then loops back to decision block 190. Thus, if the user had 
paused the current sound file by pressing the record button more than 750 
milliseconds after it was previously pressed, play is again resumed by pressing the 
record button again, as indicated in decision block 200 and block 202. A negative 
result in decision block 200 also returns to decision block 190. 

15 A negative response to decision block 192, indicating that the record button 

was not pressed while the voice recorder is playing, leads to a decision block 204, 
which determines if the exit button had been pressed. If so, a block 206 
immediately stops playing the current file. Thereafter, the logic again returns to 
decision block 190. However, a negative response to decision block 204 leads to a 

20 decision block 208. In this decision block, the logic determines if the rocker down 
button has been pressed. If so, a block 210 provides for waiting 500 milliseconds. 
Next, a decision block 212 determines if the rocker down button was released and if 
not, starts fast play as indicated in a block 214. The logic then returns to block 210 
to wait another 500 milliseconds. Thus, so long as the rocker down button is held 

25 depressed, fast play of the recorded file continues and at 500 millisecond intervals, 
the logic checks to determine if the rocker down button has been released. If it has, 
a block 216 provides for stopping the fast play. Thereafter, the logic proceeds to a 
decision block 218. Decision block 218 is also reached if the results in decision 
block 208 are negative, i.e., if the rocker down button had not been pressed. 

30 Decision block 21 8 determines if the rocker up button has been pressed. If so, the 
program waits for 500 milliseconds as indicated in a block 220, and then determines 
if the rocker up button has been released in a decision block 222. If so, a decision 
block 230 determines if the rocker up button had been held for less than 500 
milliseconds. A positive response leads to a block 232 in which the logic causes the 

35 previous file (if any) in the list to be played. This file continues playing, as 
indicated in a block 234. Block 234 is also reached from decision block 230 if the 
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rocker up button had been held for more than 500 milliseconds. Thus, decision 
block 230 determines if the rocker up button was simply tapped, and if so, plays the 
previous file. If not, the current file continues playing. The logic loops back to 
decision block 190. A negative response to decision block 222 leads to a block 224 
5 in which die play of the current file is stopped. An audible beep signal is then 
provided through the speaker of the hand held digital computing device to indicate 
that the logic is about to rewind the current file. A block 228 then provides for 
rewinding through two seconds of real time recording, which corresponds to 
500 milliseconds of rewind time, since the rewind occurs at high speed. The logic 

10 then loops back to block 220, to wait 500 milliseconds while the rewind occurs. 
Again, decision block 222 determines if the rocker up button was released. If not, 
the loop again repeats to rewind an additional two seconds of real time recording. 
Once the button is released, a negative result in decision block 230 will continue 
play from the current point in the sound file that was reached by the rewind 

1 5 operation. 

Although the activation of voice recording is disclosed as a function that is 
implemented in response to the record button being pressed, it should be apparent 
that other functions could equally well be activated by any of the hardware control 
buttons provided on the hand held digital computer. All that is required is to 

20 associate the appropriate control button with the function that is to be actuated in 
the registry of the operating system. 
Description of RegisterHotKevO API 

The RegisterHotKeyO API defines a system-wide hot key in accord with the 
following: 

25 BOOL RegisterHotKey( 



Parameters 
hWnd 

Identifies the window that will receive WM_HOTKEY messages 
generated by the hot key. If this parameter is NULL, WM_HOTKEY messages 
35 are posted to the message queue of the calling thread and must be processed in the 
message loop. 



HWND hWnd, 
int id, 

UlNTfsModifiers, 
UINT vk 

); 



// window to receive hot-key notification 
// identifier of hot key 
// key-modifier flags 
// virtual-key code 



30 
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id 

* Specifies the identifier of the hot key. No other hot key in the calling 

thread should have the same identifier. An application must specify a value in the 
range 0x0000 through OxBFFF. A shared dynamic-link library (DLL) must 
5 specify a value in the range OxCOOO through OxFFFF (the range returned by the 
GlobalAddAtom function). To avoid conflicts with hot-key identifiers defined by 
other shared DLLs, a DLL should use the GlobalAddAtom function to obtain the 
hot-key identifier. 
fsModifiers 

10 Specifies keys that must be pressed in combination with the key specified 

by the nVirtKey parameter in order to generate the WMHOTKEY message. The 
fsModifiers parameter can be a combination of the following values: 

Value Meaning 
MOD_ALT Either ALT key must be held down. 

15 MOD_CONTROL Either CTRL key must be held down, 

MOD_SHIFT Either SHIFT key must be held down. 

vk 

Specifies the virtual-key code of the hot key. 
Return Values: 

20 If the function succeeds, the return value is nonzero, 

if the function fails, the return value is zero. 

x 

! Remarks about the API: 

When a key is pressed, the system looks for a match against all hot keys. 
Upon finding a match, the system posts the WM HOTKEY message to the 
25 message queue of the thread that registered the hot key. This message is posted to 
the beginning of the queue so it is removed by the next iteration of the message 
loop. 

This function cannot associate a hot key with a window created by another 

thread. 

30 RegisterHotKey fails if the keystrokes specified for the hot key have 

already been registered by another hot key. 

If the window identified by the hWnd parameter already registered a hot 
key with the same identifier as that specified by the id parameter, the new values 
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for the fsModifiers and vk parameters replace the previously specified values for 
these parameters. 

WindowsCE additions: 

The hwnd parameter may not be NULL. 
5 There is no restriction on the id parameter. 

There is a new MOD KEYUP flag which can be passed in. If 
passed in, the window will be sent a WM_HOTKEY message on key up in 
addition to on key down. 

For messages being sent on a keyup, the modifier in the loword of 
1 0 the Iparam of the WM HOTKEY message will have the MOD KEYUP flag set. 

Applications that do not pass in this new flag while registering v 
their hotkey will only be sent the WM_HOTKEY message on keydown events - 
this is the windows compatible mode of using this API. 

Although the present invention has been described in connection with the 
1 5 preferred form of practicing it, those of ordinary skill in the art will understand 
that many modifications can be made thereto within the scope of the claims that 
follow. Accordingly, it is not intended that the scope of the invention in any way 
be limited by the above description, but instead be determined entirely by 
reference to the claims that follow. 
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Hie invention in which an exclusive right is claimed is defined by the following: 

1. A digital computing device that immediately implements a 
predefined function in response to a user action, independent of whether a main 
user interface is currently running on the digital computing device, comprising: 

(a) a power supply for providing electrical power to energize 
the digital computing device; 

(b) a memory for storing machine instructions; 

(c) a switch disposed on the housing; and 

(d) a processor, coupled to the memory and to the switch, for 
executing the machine instructions to carry out a plurality of functions, a portion 
of said machine instructions comprising a stub program that runs until the power 
supply is de-energized, and another portion of the machine instructions 
comprising a main program that is substantially larger than the stub program and 
which is selectively executed by the processor to provide the main user interface, 
said stub program being adapted to immediately respond to a user actuating the 
switch by implementing the predefined function, even when the main program is 
not currently running and the main user interface is thus not currently available. 

2. The digital computing device of Claim 1, wherein, if the main 
program is not yet running, the stub program is adapted to cause the processor to 
launch the main program in response to the user actuating the switch. 

3. The digital computing device of Claim 1, further comprising: 

(a) a microphone that produces an analog signal corresponding 
to sound waves that are incident on the microphone; and 

(b) an analog-to-digital converter coupled to the microphone 
and to the memory, said analog-to-digital converter converting the analog signal 
produced by the microphone into a digital signal that is stored in the memory, 
wherein the predefined function comprises storing the digital signal from the 
analog-to-digital converter in the memory to record the sound waves incident on 
the microphone. 
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4. The digital computing device of Claim 3, wherein the stub program 
is adapted to cause the processor to at least temporarily store the digital signal in 
the memory until the user stops actuating the switch. 

5. The digital computing device of Claim 4, wherein the stub program 
causes the processor not to save the digital signal at least temporarily stored in the 
memory if the user continuously actuates the switch for less than a predefined 
interval. 

6. The digital computing device of Claim 5, wherein the stub program 
causes the processor to launch the main program if the user continuously actuates 
the switch for less than the predefined interval. 

7. The digital computing device of Claim 3, wherein the stub program 
further compresses the digital signal and saves the digital signal in the memory in 
a compressed format. 

8. The digital computing device of Claim 3 5 further comprising: 

(a) a sound transducer that produces audible sounds in 
response to an applied analog signal; and 

(b) a digital-to-analog converter that is coupled to the memory 
to receive the digital signal stored therein and to the sound transducer to provide 
the applied analog signal, said applied analog signal corresponding to the digital 
signal, so that said sound transducer produces audible sounds corresponding to the 
digital signal to play back sounds substantially reproducing the sound waves that 
were incident on the microphone. 

9. The digital computing device of Claim 8, wherein the main 
program includes functions for controlling the playback of the digital signal stored 
in the memory. 
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10. The digital computing device of Claim 9, further comprising a 
plurality of controls adapted to be actuated by the user, at least one of said 
plurality of controls initiating the playback of the digital signal stored in the 
memory to produce the audible sounds with the sound transducer. 

11. The digital computing device of Claim 10, wherein one of the 
plurality of controls is adapted to cause the playback of the digital signal at a 
speed substantially greater than a rate at which the digital signal was provided to 
the memory by the analog-to-digital converter. 

12. The digital computing device of Claim 10, wherein another of the 
plurality of controls is adapted to rewind through the digital signal stored in the 
memory. ; 

13. The digital computing device of Claim 1, wherein the machine 
instructions cause the processor to store the digital signal as a file, in a folder 
specified by the user. 

14. The digital computing device of Claim 13, wherein the machine 
instructions cause the processor to enable the user to identify the folder by 
selecting it from a plurality of folders. 

15. The digital computing device of Claim 13, further comprising a data 
port adapted for transmitting the file to another computing device. 

16. The digital computing device of Claim 3, wherein the machine 
instructions cause the processor to enable the user to record sound with the 
microphone, for inclusion in an e-mail message. 
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17. A method for immediately implementing a predefined function in 
response to a user action on a digital computing device, independent of whether a 
main user interface is currently running on the digital computing device, 
comprising the steps of: 

(a) executing a stub program that runs while the digital 
computing device is energized, a separate main program that provides the main user 
interface not being required to execute while the stub program is running; 

(b) providing a switch on the digital computing device; and 

(c) immediately responding to a user actuating the switch by 
implementing the predefined function, even when the main program is not 
currently running and the main user interface is thus not currently available, said 
predefined function being initiated by the stub program without a delay that is 
required to launch the main user interface. 

18. The method of Claim 17, further comprising the step of launching 
the main program in response to the user actuating the switch, if the main program 
is not already running. 

19. The method of Claim 17, further comprising the step of providing a 
microphone on the digital computing device, wherein the predefined function 
comprises storing a digital signal corresponding to sound waves incident on a 
microphone. 

20. The method of Claim 19, wherein the digital signal is at least 
temporarily stored by the stub program until the user stops actuating the switch. 

21. The method of Claim 20, further comprising the step of discarding 
the digital signal if the user continuously actuates the switch for less than a 
predefined interval. 

22. The method of Claim 20, wherein the stub program launches the 
main program if the user continuously actuates the switch for less than the 
predefined interval. 
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23. The method of Claim 1 9, further comprising the steps of: 

(a) compressing the digital signal; and 

(b) saving the digital signal in a compressed format 

24. The method of Claim 19, further comprising the step of producing 
audible sounds corresponding to the digital signal that was stored, thereby 
substantially reproducing the sound waves that were incident on the microphone. 

25. The method of Claim 19, further comprising the step of providing 
functions for controlling the playback of the digital signal that was stored. 

26. The method of Claim 20, further comprising the step of initiating 
playback of the digital signal stored in the memory to produce the audible sounds. 

27. The method of Claim 26, further comprising the step of selectively 
causing the playback of the digital signal at a speed substantially greater than a 
rate at which the digital signal was saved. 

28. The method of Claim 26, further comprising the step of selectively 
rewinding back through the digital signal during its playback. 

29. The method of Claim 17, further comprising the step of storing the 
digital signal as a file in a folder specified by the user. 

30. The method of Claim 29, further comprising the step of enabling 
the user to selectively identify the folder from a list of a plurality of folders. 

31. The method of Claim 29, further comprising the step of 
transmitting the file to another computing device. 

32. The method of Claim 19, further comprising the step of enabling 
the user to record spoken words for inclusion in an e-mail message. 

33. The method of Claim 29, further comprising the step of enabling 
the user to play a selected file in which the digital signal is stored. 
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34. The method of Claim 33, further comprising the step of enabling 
the user to selectively play all files in a selected folder by double clicking the 
switch. 

35. A method of communicating between a control on a digital 
computing device and a process for recording input data, comprising the steps of: 

(a) assigning the control to a stub program executing on the 
digital computing device, as a registry entry; 

(b) executing the stub program that monitors the control, said 
stub program running independently of a main program that produces a user 
interface; and 

(c) responding to a user actuating the control by passing a 
fastjceypress notification to the stub program, to immediately initiate recording 
of the input data. 
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